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, An experiment is reported in which an attempt was-' 

. ma^e to l?ias collegd^^^j^dents* observjations of a videotape .of 
•children at pla>^T!5ip^''l^udy is* framed terns .of H.I. Thomas* id 
concerning the defi^a^ion of th? s4.tiiat%pn.>0jy$erver *bias is an 
instance when a deflation pf ' a si4^t^:cai, is based primarily dn v. 
si^bjective srttiat,iob:jOr factors. Relian^^^^ on subjective situational 
factors is. dependent on the degree ^f anibiguity of^^he situation's , 
obj^c^ive factors, students were given false information concerning^ 
the 'SbcloeconODSicT Status '(SES) of the ji;hildren in "^he videotape 
(manipulation of subjective situation^aJL factors) . -Also; the degree of 
ambiguity of the vide^gjoape (manipulation of ambiguity of ob'jective 
situltional factors^^as vairied. The students were asked to record 
all ag^^xessive berhavior exhibited b,y the children,. The information 
ab6ut the childtenVs SS5 rdid affect the- student^s* observations* The ^ 
^degre^ of ambiguity of the videotape failed to produce the 
hypotlifesized effects. XA^th6r>fBJJ5) - ' ^ * 
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DEFINITION OF' 'the SITUATION AND' OBSERVER 'BIAS ^ . 
^ * Abstract 



An experiment is reported irx which an attempt was made to bias 62 
S's observations of a videotape of children at play. The stfldy ig 
framed in terms of W. I- Thomas's id6as cdhceming the definition of the 
situation. Observer bias is an instance wh.en a definltlbn of a 'situation 

' • . ■ ■ ■ . ■ ' '■ *• /' 

is based primarily on subjective situational factors;- Reliiatice oji . /• 

subjective situational factors is dep^deat upon the degree of aiftbi&uj.ty 

of the situation's objective factors. S's were given false infoi^naticm . 

concerning -the SES of the children in the vldejbtape (raatiipulation of - 
• ' * ^ » • , • ■ 

subjective situational factors) and by varying the degree of ambiguity.. ^ 
of the videotape (ma^pulation of ambiguity of objective- sitiia-tional 
factors) . The S^'s were asked .to record all aggressive behdVio.r exhibited 
by theo children. • The information about the children's SES\did^f feet 
the S's .observations. T]he .degree of . ambigtilty of the yitieo tape failed 
tq produce the hypothesized effects." ^ ' • 



DBFIi^ITION OF^HE^ SITUATION AND OBSEI^j^ER BIAS 

Robert Rosentihal's'^ research ' CQn^Cerriing experimenter effecta or the 
unintended effects an ^xperimeT\tet has oh the results of his experiment 
has stimulated a greaf deal of empirical work and discussion. Altl?ough 
the evidence is nelT conclusive, tlje literature suggest, that experimenter^ 
effectSiare found not only in the experimental situation (for example,*^ 
Dusekj ^^71;" Laszlo and RosenfTiLar\ 1970^ Minor, 1970; Wessler, 19^9; 
Rosefnthai and/^ode, 1963) Jjut , also\^^he school setting (for example, ^ 
Rosenthal arid Jacobson, 1966),vt:he i^inical setting (for example, ttersh, ; 
L9t7I; Rosenthal, 1969c; MalBliiig, 1965; Wallach .and Strupp, 1960) ^nd - 
the psychcrlogical testing situatidn *('^'or example, Dana and Dana, :^969; 
Egelahd, 1969; Wessler, 1968); These studies support Rosenthal's 
argument that e.xperimen^er effects can occur in a variety of s'^ocial 
situations and that by studying experimenter effects in the research 
, setting^ we will liSarn more'about social behavior in general (Rosenthal, 
1969a, 1966').. . ' ' • " - • - 

Experimenter effects fall into two general categories: 1) npn- 
interactional and 2) inter&cti6nal. Non- interactional types of experi- 
mecitei: effects operate withdut affecting the actual responses of the 
subjects in the research. Interactional experimenter effects are a resul 
of^the experimenter ^s intefaction^with his subjects\and operates by • 
influencing a subject's response. , ^ . ^ • \ 

Tlost of the empirical work eondemin'g 'experimenter effects which has 
been, done has examined irrteraotioiial types effect^, the most 



frequently chosen one being experimenter expectancy. For example, ^ / | 
most of Rosenthal's work has been devoted to studying the effects^ d{i4 to * 



the experimenter's expectancy or hypothesis concerning^ the resuLt^^bf* 

hia experiment. There has been* a Isfck of attention paid to the ndh^ 

/ ^ . ' • ' T 

'interactional type, and our tesearch is an attempt to begin to fill - 
.t^is gap^ The non-interactional experimenter eff^t with which we will 
be concerned is observer bias, ^ \ { • '■ 

Observer bias isMefiried as a "tendency to'' observe the phenomenon" 
under study "in .a manner - that differs from the 'ttrue' observation in some 
consistent fashion-" (Simon, 1%9). - Bias observations ar© systemat-ic 
distortions of 'social "reality." SlncQ we are treating ^'server' bias as 
a non-interactional expet^imentet ef feet , ^we will limit Our discussion tO' 
only those observational settings iti which the observer hds ho inter- * 

' * ' ' ' . 0 ' H 

personal contact with the Subjects while the-) are under observtition. We ' 
will also attempt to show that observer l^ias can be explained in part, by 
the process which W. I. Thomas labeled a^.^"the definition of the situation 
(Thomas, 1923), We will be particulary ^interested in Thomas's ideas 
concerning objective and subjective situational factors, ^ ^ 
This rfe^jearch will not only add ^to our kijowledge concerning sopie ► 
of the- variables, whigh arp associated with the oOcurrende of observer, 
fcias, but more generally to our kftowledge of non-J-iriteractiona]^ experi-' 
menter effects. It will also begin to tie the experimenter effects 

/ • • < 

literatui*^ to feome existing theoretical idea^.. The experiiitertt'eT effects 



literature, except for an occasional post hoc analysis using Merton's 
concept of self-fulfilling prophecy (Rosenthal, *1969a 1-966) is lactin^ 
in theoVetical work aimed at e^^plairiing the. existence ol?S|^he^ various 



kinds of experimenter, jeffects/ In our review of the experimental effects 
literature, we' found, no research which froifc the onset was basBd on any^. 
theorjetic^ idl^as. fiy usii>g Thomas '6 ideas about the definition of the 

situation we hope to fill in the theoretical jgap in the experimenter 

\ ^ ' \ ' . / 

effects* literature. / . ' 

' . ' i • • ' ' . • . ' \ 

-. ■ ' * 

Theoretical Rationale " 

'■ - : ' - / 

Although the phenomenon of observer bias and ways of dealing with 
it are discussed in the literature dealing with research methodology 
(for example, Hutt and Hutt, 1970; Simon, 1969; Madge, 1965; Goode and 
Hatt, 1952), not much empirical or theoretical v^rk has been devoted 
specifically to it. The little 'fempirical work that has focused on 
observer <bias (White, et al., 1970; Cordaro and Ispn, 1963). 
suggest that observer' bias bijp be axperlmen tally produced when prior 
information conceiTTiing the observational situation is given to observers. 
In'both studies, observers were given information foncerning the amount 
of behavior^o ]()e expected^and their observations wpre in the direction 
•of these expectations. Although these studies do indicate the existencie 
of observer bias, neither provfde us with an explanation for the pheriom- \ 
enon. If we look at some of W. I. Thomas ' s ideas concerning the concept, 
definition of the situation, we f i^nd .such an explanation* y 

Thomas argues (1937, 1923, 1918) that before an indyiSual can 
act in? a situation, he must first give meaning to the: sitjuation in terms 



o 



f his action orientation, that is^ his reason for act/ing. This is* done 



by^the individual siilecting, attending to, and combining those elements 
of the situation which are -most rjelevant to his goal, "rfie synthesis of 
the relevant aspects or definition of the situation enables ^he individual 



to"-decide the most appropriate way in' which 'to ^ct in the situation. 

In Thomas/s conceptualizations, there are -both oblective and sub- 
jective features which can influence an individual's definition of the 

/- 

situation (Thomas., ^923). Objectivity features are tho^se which have- a 
'Verifiable existenciJ^ which a scientist or any other outside individual 
living in the society would recognise. These include the physical 

feature^ of^the situation and th^ sdcial norms associated with it [ 

, t 

(Stebbens, 1967; Thoriias and Thoiftas, 1925). The subjective featurej of the 
situation are those aspects* which are related to the unique experiences 
and perspective of tjiie individual. These include/his past experiences v 

/ - ^ ■ " ■ . 

with s imildtLu^tuat ion's , his expectations concerning the type of behavior^ 
found in such a situation and his values and attitudes associated with 
t\yQ situation. In a sense j the subjective features of a situation exist I 

f only in the mln^ of the particular individual. Because of these 
s\ibjective features;. diff(iren-4^ definiticms of the situation may result * 

•among people in the same situ'ation. Widely different behavior can there- 
fore re^suit since one's behavior is closely related to one's definition 
of the situal^lon (Stebbens, 1967; Vplkart, 1951). | • 

Jn other words, individuals will act on the basis of a definition 
constructed from both objective and subjective^ situational features, but, 
it is possible that the subj[ective features may be the major influence 
in the definitipn of tbe'' situation . The individual will behave as if 

the subjective features were" tangible, that is, he Vill act on the basis 

I 

of the definition constructed from those j^ub^ective features. '*If men 

define situations as real, theyare real in their I consequences'' (Thomas and 

Thomas, 1925) • It is our contention that this' is what .happens when 

V 



observer bias occurs. * ^ ' ^ 

Observer bias is an example of an instance in which subjective ^ 
factors play a large part in the formulation of a definition of a 
situation. An observer is told to watch and record data about a 
particular type of behavibr concerning -,the subjects under study. This , is 
his action orientation. However, before an observer can act, that is 
watch and record, he must fir^t define or give meaiiing to the situation 
under observation. This may include, for example, attributing certain 
types of characteristics to the subjects under study because of his past 
experiences with them, his value's or attitudes towards them, etc' Theae 
characteristics may not actually exist, but they nonethelo^ become part 
of an observer 's. definition of the situation because. he thinks they 
exist. Because his definition of the situation infldences his watching , 
and recording, the data resulting from his observations will be biased or 
distorted, and the distortion will be in. line with his definition of the 
situation.' It could be argued that the researchers who have been 
concerned with experimentally manipulating observer bias (White, ' 
et al., 1970; Cordaro and Ison, 1963) incre^ed the probabilit^r 
(^that subjective factors would play a large role in the observer's definition 
of the 'Situation because\hey provided them with expectations concc^rning 
what they were about to observe. i 

But what about the abjective situational factors in the observational 
situation? They too can play ^ part in the Construction' of definitions, 
of situations. Most of the time situations a^re defined on the basis of 
objevctive features. If- this were not the case, any type of group 

behavior would be impossible. ^ Why do they not counteract the distorting 

■ 
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effects of the subjective features in a^n observer bias^ situation? WeJ 
would argue that when subjective factors play a large part in the 

construction of definition of a situation which results in observer bias 

f ' ^ \ 

it is because the objective situational factors are uhclear and 'ambiguQus. 

s Thus, if the objective factors of a situation are clear and easily 

^ .recognizable, sga observer's definition will not be under the influence 

of subjective factors to the same extent, and the probability that 

observations will be biased will be less. 

Although Thomas^ does n,ot specifically discussf, when subjective factors 

will most likely predominate in the formulatidih of definitions of 

, situations, he! does argue that on the whole the definition .of the sitwption 

is "equivalent to the deterrninatlion of the vague" (Thbtiias, |1923) . It ■ ^ 

^ ' ' I • 

seems a. logical extension of thisO^dea that if objective factors are 
ambiguous or not strong enough to guide th^ individual in attributing 
meaning to the situation, the role of subjective factors will become 

• s 

important and may even play a larger part in the definition process. 

• There is support in the social science literature for the contention * 
that the degree to which a situation^ is ambiguous will affect how an 
individual will act in a situation. For example, one's perception of an 
object is modified according to how ambiguous the object is (Reese and 
Ford, 1962; Bruner, et al. , 195lf; Bral'ey, 1933; Carmichael, 
et al., l932). The probability that a subject will accept a 
suggestion or behavi6ral cues from an Experimenter is associated with the 
^ ambiguity^ of the task whioti the subject is to perform (Patel and Gord^n^ 
'I960; Coffin, 1941). There is also eviflence from the conformity 
li^terature CHoving,et al. , 1969; Crutchfield, 1955) that ambiguity plays 
a role- Looking at the* experimenter effects literaCure, we find 

9 
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additional evidend!e that ambiguity w-ill al?fect tehaviWt (Feltbn, '1971; 
Weiss, 1969) • This research suggests that subjects are more likely «to 
act in accordance wi,th an experimenter's hypothesis when the situation 
is ambiguous. * j 



Independent arfd Dependent Variables . 

We decided to test the ef fecl;s which subjective situational factors 
and situat:^onal a^bigui4:y have on the occurence of observer bias. It is 
our assumption that observW bias is a behavioral outcome of the definition 
of the situation process. . We f^el that observer bias is an instance when 
subjective features play a large part in the definition of the situation 
process^. However, this influence modified by the clarity of the 
objective features of the situation. 

Because subjective situational features include many aspects of a 
situation, it would be impossible to manipulate and test the effects of 
all of them in terms of observer bias* Some of the previous research on 
observer bias (White et al., 1970; Cordaro and Ison, 196-3) provided the 
observers with informati^^n* concerning the amount of behavior to be 
expected from the subjects. Sin^ce expectations »concerning the type of 
behavior associated with a situation is a subjective situational factor, 
we decided xo concentrate oiir efforts on a similar kind of expectation. 
We went a step further and linked the expectation to a particular 
category of people or group since .we felt thjLs would be more akin to an 
actual observational situation. We attempted to manipulate the observers 
expectatidns cor^eming the behavior of a particular group in order to 
determine whether this type of expectation could make some observers more 
prone to observer bias.^ 
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Our first independent variable, expectations concerning the behavior 
GTf a» particular group > 'is nominally defined as antlci^iQjtion that a 
particular kind of behavior will more likely be associated with one group 
than another. , / 

Our second independent variable is situational vambi'guity . This 
variable is jaominally defined as the extent to which^'a situation allows 
for more than one interpretation, that is, it has tvo or-more possible 
meanings because the objective features of the situation are not cle^r or 
readily apparent. It is oi^r contention th^t situational ambiguity can 
modify the relationship between subjective situational features, specifi- 
cally expectations concerning the behavior of ^particulars group, and 
observer bias. If objective features of" a situation are clear or easily, 
recognized, that is, unambiguous, an observer's definition will not be 
under the influence of subjective features to the same extent. Tfie 
probability that his Observations will be biased will bevXess. 

Methodology 

c ^ 

The^ laboratory setting consisted of 62 observers watching a video 
tape of nursery school children at play. The observers were to record an 
instances of aggression which they saw on the video tape and to. note thes 

instances next to the appropriate ca^tegory on aerating sheet, Aggre^ssive 
behavior was the focus of observation. 

. The experimental rootn contained one television stet with a vitfeo 
recorder, one chair for tihe experimenter which was adjacent to the 

. television and the recorder and two to six chairs for the observers-t 
These latter chai^rs directly faced the television and the recorder. . l^Hten 
the observers were seated they faced the experimenter's left stde. ^The 

^ 11' , 



chairs were positioned in this way in order to.av61d djirect eye contact ^ 
with the experimenter duritig the experimental sessidn. The experimenter 
remained in the experimental room throughout the session slpce she told 
the observers when each taped sequence was over, so that they could st^t 
a new rating sheet. A clean rating sheet was used, for each taped 
sequence. » . 

Treatment * . . • 

Observers' expectations about the behavior of a particular group 
we^re manipulated by presenting them with information concerning the social 
Claris stattis of the children in the videotapes before the tapes were 
viewed. One group of observers was told the 'children in the tapes were 
middle c}.ass and because 'mld^lo" class parents are competitive and want 

■ . ^ _ . 1 

their children to be successful Ifi later life, they encourage aggressive <^ 
behavior in them. As a result of the social class status of tiie children, 

\ - , ' ■ ■ - 

the observers were told to expect p lot of aggression in the videotape. 
Another group of^bsorvers were told. that the children in the tape were 
lower class, j Lower* class parents encourage aggressive behavior in their 
children Oo ' that ^ey will be able to endure' the harsh living conditions 
that they mujst face. Like thQ previpus group, this group wa^ also told 
to expect a lot of aggrefjsive behavior because of the relationship be-*^ 
tweep lower class status and aggressiveness. A third group of observers 
was told nothing about the class, posit ion of the children nor were they' 
given any expectations concerning the amount of aggressive behavior that 
they would see. ^ 

Situational ambiguity was manipulated through the use of two dif~ 
ferent videotapes. One consisted of eight sequences in- which the 
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children exhibited behavior whibh w^^clearly aggr.essive^lti' natu^'e, Ihe' 
other tape consisted o"f elej^ensjequerices , two of which' were aggresssivQ 



v1. A,. ■ 



in nature and whic^|r^o 'Appeared in, Tape I, The other sequences in ^ 
Tape qCI were nj^Ccl^ ^&5^:^tfeeir aggressive nature. ^ . v 

^ .Tapev;^ was coris-idered to be a npn--ambiguous situation while Tape 
II wasf /considered to b^ an ambiguous . situation. Both tapes were 22 ^ 

minu|i.es long and wi^re of , the' same preschool children (ages 4 and 5) at , 

. ^ • ■ _^ ' ; 

plg,y^ iii' .a. nursery school setting* The behavior o£ the children was spon- 

> r taneous and we made t;io attempt while taping the cbildren-to get them to 

' " . • ■ ■ . , • ^. > ■ ■ ' ■ 

V * act in any particular Vay^ 1 ' ' # ■ 

Experimental Groups > , . , 

' • ■ • • • ■ ^ , * ■ ^ - ' ^ ^ ' 

' vV| 'Sixty-two observers were randomly assigned to one of six groups. 

xlie groups were distinguished ^ccordittg to ,the type of tape the observers ' 



t^l^/^if' watched 'and according to what_ kind of expectation they .received regaiifdi' 



' ■ / , , ^the social class of the children in IShe t^^- ^ atten^t was made to ' 

% eyeniy divide the groups according t.d-sex^^P'bbserver . Due to scheduling.^ * 

p,J problem^^ %o of the groups were not evenly^ivdded by sex, however,. . Both ' . i 

of these ^groups contained six males 'and 'five, f emia^^es • .In tnfe rest of this 
~ paper, we will use the following symboXs.fp ^^ei:/ thessix: groups; 

1) MCN^^^- group which wajs told the children j^ere middle class 

. and also watched the rion--ambiguous^i tape,, t^^ is the one . 

, with a- large amount o| clear aggtes|^ioti'(tot^i N for this 

: ; group was 10 > five males and five femle^)^.^^ 

2) MCA group which was told the children 'were middle class 
and also watched the ambiguous tape, that is the one with 



5er!c 



a small amout^ of . clear aggression (.total N. lbr this group was 



N \ 
/ 



• , " f * ■' ■ 
11, six males and five females). ' . 

3) LCN — r' group which was tol^'Tfiiat the children were lower 
'class and who watched the non-ambiguous tape; the clearly 
aggressive- one (total N for this grojupT' was 10 , five males 
and five' females) . - * - ' 

4) f LCA ~ group which wks told the "children were^lower class /* 

and who watched the ambiguous tape , the one with *a small 
amount of clear aggression (total N for this ^oup was 10, 
fiv6 piales and five females). - " 

5) CON — group which, was told nothing about the social class ^ 
of the children and who* also watched the^ non-ambiguous 
tape, -the one, with a larg;e* amount of clear Aggression (total 
N for this group was 11, six males and five .females) . 

6) COA — group which was told nothing about social class 
o^ the children a^d who also watched the ambiguous tape, the 
one with a small amount ^f clear aggression (total N for this 
group was 10, five males and five females) . 



Hypotheses * , 

The following are the hypotheses that this research evaluated: 
Hypothesis la: Obseirvers holding expectations that middle 
class children are more aggressive than lower class children 
will record more aggression than observers not holding any 
expectation about the social class of the children observed. 

Hypothesis. lb: Observers holding expectations that lower 

V 

class children are more aggressive than middle class children 
will record more aggression than observers not holding any 

. • . . ■ S ■ 
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' expectations about' p-he social "class of the(children deserved. \ i 

E3rpothesis Ila: /Jn the presence of . the ambiguous videotape, ' ^ 

• " '. ' . * " • » 

\ * " 

the effects of observer expectations linking middle class 

children witK aggression will be B^e pronoynced than in j 

the presence of J^e non-ambiguous videotape. , * . 

^ ' Hypothesiis lib: , In the presence of the ambiguous videotape,' 
the effect of obg^i;ver expectations lipking lower class 
* children with aggression will be ttiore pronounced than in 
the presence of the non-ambiguous videotape. 

Sample *a . 

The sample bsed^Un* the experiment consisted of 62 undergraduate 
students (32 males and 30 females) who. were enrolled in introductory 
sociology courses in a large midwestem university during the months of 
January through May, 1923, All were volunteers and they had been recruited 
for tlie experimenter by the instructors- who taught the courseis in 
.which the subjects, were enrolled. The average age of the observers was 
19,95 years and they were mainly freshmen 'and sophomores. 

Procedure " • . . 

Each observer was contacted by the experimenter by telephone and 
a^a^pointment wa§ made to view the vi\ieotap€. Groups of two to six 
subjects wete each experimental session depending on how many 
observers in a particular group were able to come at the particular time - 
of the sess-ion. Inspecti9n of the means suggested that the size of the 
group did not affect the '^observers ' ratings of the children. 



the observers entered the experimental room at the same 

/■'^- •' ' ' ' • \^ 

tijiife aj^j^pmpanied by the experiirienter . They fdund an instruction sheet 
j/a(n(j ^i^^et of coding sheets on their chairs faqe down. After everyone was 
s§4t6dv Athe experimenter read the instructions iloud to the observers. 

. , - ■ , / . . ■ . ^ - ^ 

fligy were asked ttT follow along; all of the' groups read the following 

Instructions: " . 

Before tWe begin, I'd like to thank you for doiiiing today. 
As you l^now, I^ain working on my Master's thesis i I am 
trying to s,Q€t, if previous findings on' children's aggression 
hold toda^, ' , 

I would like you to watch a film of four and five ye§t old j 

• ■ . i, * ' 

children playing and then fate thfem on aggression uaing the 

rating sheet whiclfe I" have given you, /The film is divided int 

several sequences, and I'd like you to use a separate sheet 

for each sequence. I will tell you when each sequence is 

over so yOu will knoC5, when to start a hew rating sheet. 

Please put a check in the appropriate box whenever you see a 
child doing what the category describes. Be sure to Include 
all behavior even that which occurs during play* The categories, 
also take ^verbal statements into account, so don't forget to 

't 

include aggressive speech. \ . 

Before showing the videotape of the children, the observers were 
shown a tape of five sequences which portrayed policemen inteJractin^; with 
citizens. The tape was approximately seyen minutes long and it was 

intended. as a practice in order to familiarize the observers with the 

■ . * ** ■ # 
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categories , on the rating sheets^ The rating sheet was composed of the 

C ■■ ■ ■ . , ^ — ■ ■ 

following categories: 

' !• Tells a child what to do ^1' . ' • 

; " . • ' . ' . • . 

2. Hblds or >res trains a child 

^3. 'Shov^ ochild arid/or 'object " ' '.^ 

' ^ , . ^ ••/(•. ' ■ V 

4. Gets in the way of another cbild ' . * . | 

5-% Kicks ^ child and/or object , * - 

6. TakQS something away from another chilH ' , ^ 

(. 7. Hits child and/6r object - ' ' 



8. Throws qbjecr 

9. Threatens a child physically and/or verbally 



^10. Chases another child - „ * 

After the practice tape was over the.^ questions from the observers 
answered, the information about the socioeconomic status of the children 
in the video tape was^ given to the appropriate groups (MCA, fiCN, LCA, LCn] , 
This information .concerned the amount of aggressiofi to ^ be* expected and 
information abput the social class of the children; As ^ith the initial 
s^t of instructions, this information was read aloud by the experimenter 
while the observers followed along. After'the descriptions were read, the 
observers were reminded to record all instances of aggressive behavior 
and then the videotape of the children was shown. The above procedure 
differed . in the case of the t;wo control groups (COA and CON^ by the 
omission of the reading of a de^ription concerning thfe ^gressiveness arid 
social class of the children. 



After the videotape was completed, each observer was asked to fill 
out a short* questionnaire which was aimed at gettitig, for example, 
information about his experience with children, knowledge about the^ 
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15 ... . , 
relationship lyetweeh\social class and aggression and some data abQut 

\i±s family of orientation^ A debriefing session followed in which the 

purpose of the experiment was explaitted. ^ The entire experimental; 

session, incldding the filling out of the quest iotinaiire and d4l?riefing, 

lasted approximately one hou^, . , * « • 



Results ' ' • • . 

•/ We utilized analysis o'f vatianc^ as our main statistical tool, A 

weighted means analysis was useci^ since we had unequal cell frequencies 

(Winer, 1971).^ - ^ / ^ ^ % 

^ /A three*-way analysis of variance^was run-in order to -deteinnine the 

effects. expQctaJtions about the aggressive behavior of middle Or lower 

class children and. situational ambiguity have on observer bias. The 

analysis w^ also "run in order to determine whether gender of observer 

woi^ld affect any relationship between the indep^endent and dependent 

v^rilables. The analysis of variance revealed ma^in effects due to* the^ 

exj^,ect^tipns variable and due to situational ambiguity. Both of these 

eff^ipts were significant at the .05 level (F = 4.13^, 'df 2/50; F = 7.17, 

df i/50 for expectations about cJLass-related aggression and situational 

ambi^guity, respectively). The predicted interaction effect (Hypotheses 

Ila khd lib) between expectations concerning class-related aggression and 

situat;ional ambiguity failed to r^ach sigpific^n^e. , There were no 

effedtS, either main or interaction, due to gdnder suggesting this variqtble 

did not affect the relationships predicted by our hypotheses. 

■ ) - ■ \ 

(TABLE I about here.) 



The main e'ffect for the expectations variable suggests that such J 
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exJ)ectatiOns are associated with observer bias. However, before a con- 
clusion as to whether this data supports Hypotheses la and lb is reached, 

• • • ■ ( 

we must examine the direction of this bias. In prder to do. this, the 

/V ' ' ' ' i • ■ ■ • 

marginal means representing this effect must be cotnpared/ Vfhen this is 

done, we find an interesting patteYn. All observers (groups MCA, MGN, v 

*LCA^ LCN) who were explicitly "^iven expectations concerning the social 

class membership ^f^ the children in the film were also told to expect 'a 

great deal of aggres^slon. The resulting me^ns should have beep higher than 

•those from" the observers who had not been given any expectations aboUt'^the 

behavior of thKxhildren in the film .^groups COA and CON). If we look at 

the means, we find that those observers who thoiJght they were watching 

middle class children did see more aggression * (X -40- than the control 

groups (X =34*43) but those who thought they weje watching lower class 

childreii saw less aggression (X =29.50) Lnan the control groups. The 

data seem to confirm Hypothesis la but HygBt^thesis lb is no|^..supported 

by the data* Although the observers holding expectations linking lower 

class children and aggresigive behavior did seem to* bias their observations 

when compared' to the control groups, they did so in . the opposite direction 

ot their expectat-ions- , ^ . , 

In order to determine wtiich comparisons were contributing to the 

overall main effect due to the. expectations variable, the marginal means 

were also subjected to a posteriori analysis. Schetf^ tests and 

. « ■ 

Fisher's least significant diff^ence (Isd) approach were used .(Winer, 

t 

J.^tl). The Scheffe tests revealed no significant co1npa<risons, but this 
may have been due to th^ conservative natugre of this test (Winer, ft?!)* 
On the other hand, the^Flsher's least fiigilif icarrt difference Approach 
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Indicated that; the .-comparison between the means for those observers whg 
thought they were watching middle class -children and those- who thought they 
were watching lo\}er class children was significantly different at the 
.01 level. This finding gives additional weight to the concTusion that 
observer bi^s can result if observers hold expectations concerning the 
behavior of subjects they arQ watching. However, the bias mdy not be in . 
the di^riection of the expectation. ^ As we said before;, only Hypothesis la ^ 
is supported by the data. ' . ^ 

Ndne of the other hypotheses wag supported by the data. The signifi- 
cant main effects due to situational ambiguity only suggests that the two 
films were significantly different in tremis of clearly aggressive cont;ent. 
The overall mean for the n<3n-ambiguous film was greater than the mean 

for the ambiguous film (39.1 and 30,65, respectively). " This indicates that 
♦ 

the tapes were two different type^ of observational situations but in 
-order for' our hyfiotheses (Ila and lib) dealing with situational ambiguity 
to have be6n supported* an interaction effect would have 'been a necessary 
result. ^ 

We subjected our data to further analysis in order to determine any 
effects d^ue to a third variable. As we said, gender was originally 
conceWed in this way, but our original analysis indicated that gender 
did not act as a modifying variable or corfi^ribute to observer bias. 

The next variable which was examined for additional effects 
concerned <;rhether the observers 'had any experience with^ children prior tq 
participation in tha experiment. • Again,, a three-way analysis of variance 
was done and It included thi^ experience variable, the expectatlon^varlable 
and the situational ambiguity variable. A significant (.05 level) maid ^ 
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effect due to experience did result (F =5.01, df l/50) but none of the 

interaction effects were significant. These results are questionable, 

however,, since the varianqe^ were found to be non-homogenous. Therefor^, 

a t test was done in order to. see if the marginal means associated 

with the effect due to experience with children -were significantly 

different (marginal means were X =30.56 for those without experience ; 

X =37.41 for thosfe with experience). The t test was significant at 

the .05 level (t =2.01, df 60) indicating that observers with experieffcce 

saw more aggression than those without expei'lence. ^ 

The last variable which was examined was concerned with the extent' 

to which the observers guessed the true nature of the experiment. Although 

i 

only one observer was able to determine \he exact goal of the research, 
eighteen other observers were suspicious ^at they were under study and 
not thfe a^J^ildren in the tape as they had bee\ told. Accordingly, the 
observers were divided into two grqups, those wko had no idea of tht^ 
actual of the experiment (N =40) and those who gu^sed the true 

nature or who were suspicious that they were actually .being studied 
(N =19). 

Another three-way- analysis of variance was run. The data indicate 
an interaction effect between situational ambiguity and the guess variable. 

(TABLE II about here,) 

it we look at the relevant marginal means, we find that^^v^Ken observers 
exposed to the ambiguous tape were suspicious about the actual goals of 
the experiment, they recorded approximately as much aggression as tho^e 



observers exposed to the unambiguous 



videotape. In other words, suspicious 
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observers seemed more apt to record aggression in the presence of situ- 
ational ambiguity than unsuspicious obstrv^rs. A Scheffi^ posteriori 
test supports this conclusion (p<..05). There is *a complimentary trend 

•■ ' - (TABLE 111 about hei^.) '. • 

thrbughout the data. It indicates that* observers suspicious of the true 
natute of the experiment recorded more aggression than unsuspicious ' 
observers regardless of situational ambiguity. 

(TABLES IVa-c about here). 

Discussion and Conclusions » ' « 

As stated before, the data does confirm Hypothesis la which states 
that observers holding expectations that middle class children are more 
aggressive will record more aggressic^ than, observers not holding any 
expectation about the social class of the children observed. By so doing, 
it also lends aflipport to Thomas's idea that subjective situat^ional factors 
do play a role i^ the definition of the situation process. 

It also lends partial support to the general hjrpothesis which pre- 
dicts that observers holding expectations concerning the behavior of a 
•particular group will be jaore likely to bias their data. in line wjtth those 
expectations than observers not holding such an expectation. This hypoth- 
esis is only jiartially supported since the data did not support Hypothesis 
lb. ' Altll^gli; the data pertaining to Hypothesis lb was biased, the bias 
was in th6 opposite direction tp the .observers' expectations. Observers 
holding expectations linking aggressive behavior to lower class status 
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saw less aggression than observers holding no expectations concerning 
the childreh's social class status. These data may be the result of a 
negative reaction on the part of the observes who received the expectation 
regarding the lower class children. Some of the observers who deceived 
this expectation indicated during the debriefing period that they found 
the description concerning lower class aggressive behavior- to be offensive 
^ and may have reacted to it by recording a smaller amount of aggressive 
behavior than they actually saw. This explanation is only a speculation 
since we have no substantial data, with which to^ support such a conclusion. 
More detailed questions regarding the observers' feelings and their 
acceptance of the experimental expectations could have helped settle 
this issue. 

Another possible explanation for the reverse biasing associated 
with the lower class expectation may.be gained' from some of the social- 
ization literature concerned with differential parent behavior due to sex 
of child (Meyer and Sobies'zek, 1972; Rothbart and Maccoby, 1966; 
Bronf enbrenner , 1961). Rothbart and Maccoby and Bronf enbrenner 

(1961) report that parents are more punitive toward children of the same 
sex and mojre affectionate and permissive toward children of tjie opposite 
sex. In other words, iSarents seem to have a lowser* tolerance for certain 
kinds of behavior when they are exhibited by same-sex children, 

Meyer and Sobieszek (1972) explain this finding by suggesting that 
this lower tolerance may result from the ability of parents to apply more 
complete frames of reference to same-sex children. Adults are better 
able to define and respond meaningfully to the behavior of same-sex 
children, and as a result are less tolerant of the behavior of these 
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children. This conclusion is bas^^pn data obtained from kdults asked to 

rate two children, described part of the time ap tnale and the remaii^der 

ff ' • , • ■ • * ' . ' * ■ • - , • 

'■ . • 

of the time as female, on a number of ad jectivesv The adults attributed 
» • ♦ 

the most qualities to same sex children (significant at the •OS levelX. 
Our data n^y indicate that sex Is not the only characteristic which 

- ' ' V ■ • ■ ■ ■ ■ ■ ' 

enables adults to act in this way. Social class membership may be 
Another. < 

I Most of our observers were from middle class origins. Extrapolating 
from Meyer and Sobieszek's data, we would argue that becasue of the middle 
class origins of most of our observers, they were able to make more 
sense out: of and relate to the behavior of the children described as 
ihiddle class than the behavior of the children described as lower class. 
Accordingly, they recorded more behavior for those children described as 

4 

middle class. The difference in the amoqnt of aggression which was 
recorded may have been significant because it was aggression which was 
the object of the study; aggressive behavior may have negative connotations 
in our society. Again this explanation is only ^ speculation, but it does 
tie our data to some of the socialization llteifature' and, as such, is 
wcftthy, of future research. , » ^ 

Our faiiure^to confirm Hypotheses Ila and lib concerning the 

» ' *• • * #, 

interaction effects between the expectation and situational variables 

may harve .been due to our manipulation of the latter ^i^riabl^, situational 

ambiguity. Although the significant main effect due to this variable 

suggests that we had two distinct videotapes, both tapes may have had 

. . ' ' ■ • I 

clearly objective situational factors in regard to how difficult 

* '• 

it was to discern aggressive behavior- In constructing Videotape II, 



22 ^ 

we sought examples of behavior which could be Interpreted as aggressive 
but not '.necessarily 5o. Loud talking, the articulation of which was not 
clear, a child waving his arras In front of another are two examples of 
the type of ,behavlbr which we Included In Videotape II. ^^owever, it 
,may have been that these kinds of behavior were too clearly nona^gres- 
sive and our observers Interpreted them accordingly. Periapl, If we , 

' ' '* V • V. . ' ' . C 

Jiad uaed the same vldeo^ta^e for both ambiguity conditions but Instead 
manipulated ' the clarity or focus of the ^>lcture, we may have had a 
better measure of situational ambiguity. Of ^course our failure to obtain 
any significant interaction effects between the' q^xpectation and sltuatloi^al 
ambiguity variables may suggest that the relationship between 
subjective situational factors and observer bias is not affected by 
objective situational factors. However, given out reservations 
regarding the manipulation of the situational ambiguity variable, 
further research regarding this variable is needed before any definite 
conclusion can be drawn. 

Further research into the role that prior experience with subjects 
similar to those' under observation plays in the occurrence of observer 
bias could also be done. . Although the main effect due to experience with 
children was suspect because of lack of equal variances, the t test 
indlcate^s that this varlablB may affect an observer's actions in that he 
may be more apt to attribult'e and record more Instances of ""behavior than 
observers who have not had experience with similar kinds of subjects* 

This' conclusion Is. similar to*the one reaphed by Meyer and Sobleszek ^ 

\ . . . 

(1972) concerning kdults' Interpretation of sex-typed behavior 
children* Thiis, experience may contribute to observer bias and future 
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researchers in this area couici look at this variable in more detail. 

E^tpejrience may play a rble becau'se it too may functic[n as a sv^bjective 

situational factor/ 

The data regarding whether the observers guessfeS or were suspicious 

about the true nature jof the experiment indicates what much of the 

experimeoter effects literature argues; subjects will act In accordance 

with what they belieVe to be the experimenter's 'hypothesis. The data 

suggest a trend that observers, regardless of the experimental conditions 

rejcorded more aggression when they guessed or were suspicious of the 

tt • • . ■ ^ 

actua]^ goals of the experiment th^n when they were not suspicious. This 

was expecially true when the objective situational factors were unclear 

^^^^r ambiguous. Although this latter finding must be tnterpreteS with 

caution given our reservations concerning the manipulation of situational 

ambiguity, it does support some of the experimenter effects literature 

conoemed with ambiguity (jFelton, .1971; Weiss, 1969). It would^^em 

that even research ^imed at specif :|.cally producing experimenter effects 

'. could be affected by UNINTENDED experimenter effects. ^ 

Looking 'at this research in termg of its goals, some of the data 

supporting Hypothesis la suggest that looking at obso^rver bias in terms 

/ of W. I. Thomas's ideas concerning the definition oT the situation may 
" T 

be *^oductive. It begins to link the" experimenter effects literature to 
9ome already existing theoretical work, Sub/ective situat^nal factors 
in the form of an expectation concerning the behavior of a particular 
group do seem related to the incidence* of observer bias* However, other 
variables may modify this relationship. In ^explaining the failure to 
confirm Hypothesis lb, we mentioned that connnon characteristics , between 



observers and Subjects .and/or factors idiosyncratic to the experimental 
conditions to which they were exposed (possible negatiVe reaction to the 
expectations concerning lower class children, in this instance) could 
be two such possible variables. Of course,. Hypotheses Ila and lib were 
specifically aimed at examining another such variable, ^ut the data 
failed to confirm the prediction that situational ambiguity would enhance 
the relationship between subjective siiiuational^factors and observer 
bias. On the other hand, if we consider the variable regardiijg whether 
the observers guessed the actual goaj. of the experiment as another sub- 
Jective situational factor, the interaction effect between it and 
situational ambiguity would suggetist that investigation pf the role 
, situational ambiguity plays in producing observer bias and in the definition 
of the situation process is still warranted. / ^ 

Our data suggests a line of action for those doing observational 
research and who are concerned with Observer /bias . It \Jould seem 
wise for experimenters doing observational research to attempt to 
ascertain whethe;:^hei?: observers hold an>P beliefs, expectation^ or 
experience related to the type of subject under observation.- These 
types of data should thpn be taken into account when tr^iining the observers 
and* in the final data analysis since, as our. data suggest, they could 
aff'ect the observers' definition' of the situation an<J, in fJH^rn, their 




observations. 



Footnotes 



Hartley's F wax test >f6r /l^omogeneity of varjSances was used 

to test whethdt" the assumption concerning equal variances due 

•* • 

to experimental error within each treatment population was 
met. Unless otherwise Stated^ the data met \his assumption 
at the .05 and/or .01 level (Winer, 1971).^ 

Unless otherwise stated, the main effects due to the expectations 

variable and the situational ambiguity variable remained for all 

. ' V 

additipnal three-way anf^lyses of variance. 



34 



' • ' ^ References \ ^ • 

^raly, K. ^ ; . * * ' 

1933 "The influence of past experience in the visual apprehension 
* of perception." Journal of Eicperimental Psychology 16: 
613-43/ • 
Broirfenbrenner, U- • ' 

1961 "Some familial antecedents of responsibility and leadership 
in adolescents," Pp. 239-71 in LJV, PetrlUo and B. M. 
Bass (eds.)', Leadership and Interpersonal Behavior. New 
Yotk: Holt, RiTlehart and Winston. ^ ' 

Brqner, J. S., R. D. Busiek and A. L.^Mlntprn - 

1952 "Assimilation i^ the immediate reproduction of visually 

perceived figures." Journal of Experimental Psychology 44: 
,'151-55. 

- ' / ' ' • •■' . ' 

Carmichaely L. , H. P. Hogan^-and A^ A. Walter 

1932 "An experimental study of the rffect of language on th6 repro- 
duction of visually perceived figures." Journal of Experi- ^ 
^ mental Psychology 15:73"-86. 

Coffin, T. E. ^ -i 

•1941 "Some conditions of suggestion and suggestibility: A study 

'of certain attitudinal and situational factory influencing the 
process of sugjgestion.^ Psychological Monographs 53 (No. 4, 
'(/hole No. 241)4 
Cordai^, L. and J. iBon ^ 

. 1963 "Psychology of the scientist; X-observer «l>ias in classical 
. - conditioning of the-planarian. " Psychological Reports 13: 



f,. 



ERIC 



. . . 27 . • • 

787-89. ' ' 

Crut"chfi6ld,- R. S. 

•x«"f955 "Conformity and character." Amerlfean Psychologist 10: 

191-98. . • 

Dana, J. M. and W. H. Dana 
J.969 ^'Experimenter bias and the WAIS." Perceptual and Motor 
Skills 28:694. ' 
Dusek, J. B. 

1971 "Experimenter bias In the performance of children at a simple 
motor task." Developmental Psychology 4:55-62. ^ 
Egeland, B. , • > 

1969 "Examiner expectancy effect on the scoring of the WISC." 
6:313-15. 
Felton,. G. S^^_^^^^ 

1971 ^^~**The experimenter expectancy effect examined as a function of 

task ambiguity and Internal external control." -Journal of 
Experimental Research in Personality 5:286-94- 
Goode, M. J. and R. K. Hatt , 

1952 Methods in Social Research. New^York: McGraw-Hill Book 

i 

Company. . - 
Hersti} J. B. 

1972 "Effects o£ refe/ral information on tes^^rs." Journjil of 
Consulting and Clinical Psychology 37:116-22. 

Hovlng, K« L., N. Hamm and P. Galvin 

1969^ "Social influence as a function of stlmul!ou8' ambiguity at 
J three levels*" Developmental Psychology 1:631-36. 

^ 36 



28 

Hutt, S. J. and C. Hutt 

1970 * Direct Observation and Measurement of Behavior Springfield: 

/ t 

' €• C. Thomas. 
Laszlp., J. ?. and Rosenthal 

1970 "Subject dogmatism, Experimenter status and experimenter 

expectancy "^effects.^ Personality: Ah International Journal 
- l:ll-23. 
Madge, J. ' ^ 

1965 The Tools of Social Science. Garden City: Doubleday and 
Company, Inc'. 
Masling, J. 

1965 "Differential indoctrination of examiner and Rorshach response 
Journal of Consulting Psychology 29:195-201. 
Meyer, J. W. an^ B. I. Sobieszek 

1972 "Effect of a child's sex«on adult interpretations of its 
behavior." Developmental Psychology 6:42-48. 
Minor, M. W. 

1970 "Experimenter expectancy effect as a f<unction of evaluation 

apprehension." Journal of Personality and Social Psychology 

15:326-32. 
P^itel , A. and J. E. Gordo\: 

1960 "Some piersonal and situational determinants of yielding t^ 

influence." Journal of Abnormal and Social Psychology 

61:411-18. 
"Reese, H. .W. and L. H. Ford, Jr. 

1962 "Expectancy and perception of an ambiguous figure in preschool 

children." Journal of Verbal Learning and Verbal Behavior 1: 



188-91. 

Rosenthal, R. ' * * 

1966 Experimenter Effects in. Behavioral Research. New York: 
Appleton-Century Crofts. • • 



1969a "Interpersonal expectations: effects of the experimenter's 
hypothesis." Pp. 182-277 in R. Rosenthal and R. L. Rosnow 
(eds.). Artifact in Behavioral Research. New York: Academic 
Press. . . ' 



1969b "Task variations In studies of experimenter expectancy 
effects." Perceptual and Motor Skills 29:9-10. 



1969c "Unintended effects of the clinician in clinical interaction 
a taxonomy and a review of clinical expectancy effects." 
Australian Journal of Psychology 21:1-20. 
Rosenthal, R. , K. L. Fode, C. J. Friedman and L. L. Vikan 

1960 "Subjects' perceptibn of their experimenter under conditions 

\ 

of experimenter bias." Perceptual' and Motor Skills 11: 
325-331. ' : . 

Rosenthal, R. and L. .Jacobson 

1966 ^'Teachers' expectancies: determinants of the pUpils' I.Q. 
i gains." Psychological Reports 19:115-18. 

Rothbart, M. K..and E. E. Maccoby 

1966 "Parents' differential reactions to sons and daughters."^ 
^ Journal of Personality and Social Psychology 4:237-43. , 



38 



Simon, J. L. 

1969 Basic Research Methods In Social Science: t The- Art of 
Empirical Investigation. New York: Random House* 
.Stebbens, R. 

' • ^ "i, - 

\i967 "A theory of the definition of the situation." Canadian 
Review of Sociology and Anthropology 4:148*-64. 

1969 "Studying the definition of the situation: theioty and field 
research strategies." Canadian Review of Sociology and 
. Anthropology 6:193-211. 



1971 "The meaning of disorderly behavior: teai2her definitions of 
a classroom situation." Sociology of Education 44:217-36. 
Thomas, W. I. 

1923 The Unadjusted Girl. Boston: Little, Brown and Company. 

1937 Primitive Behavior* New York: McGraw-Hill Book Company. 

Thomas, W. I. and D. S. Thomas 

1925 The Child in America. New York: Alfred A. Knopf. 
■ 

Thomas, W. I. and F. Znanleckl • 
1918 The Polish Peasant in Europe and America. Volume 1. Chicago 
The University oi Chicago Press ^ 
Volkart, Edmui>d 

1951 "Intfoductio^: social behavior and the defined stiuation." 

Pp. 1-32 in E. H. Volkart (ed.), Social Behavior and Person- 
ality: Contributions of W. I. Thomaa- to Theory and Social 
Research. New York: Social Science Research Council. 

39 



2-y 



31 

Waliach, M. S, and H. H. Strupp 

1960 "Psychotherapists' clinical judgments and attitudes towards 

patients." Journal of Consulting Psychology 24:316-23. 
\ 

Weiss, L. R. * 
1969 "Effects of subject, experimenter and task variables in 

compliance with experimenter's expectations, " Journal of 
^ Projective Techniques and Personality Assessment 33:247-56, 
Wessler, 

^1968 " Experimenter expectancy effects in psycho-iiiotot performance. 
Perceptual and Motor Skills 26:911-17. 



. 1969 "Experimenter expectancy effects in three dissimilar tasks." 

Journal of Psychology 71:63-67. 
White, J. H., R. R. Hegarty and N. A. Beasley 

1970 , "Eye contact and observer bias: a research note." British 
Journal of Psychology 61:271-273. 



ERIC 



40 



